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ABSTRACT 



A computer-based system and method for displaying a 
workspace of greater effective area than that of the display 
screen using a four-dimensional graphical user interface 
employing real-time texture mapping. According to the 
present invention, the user selects a number of workspaces 
to be displayed. Each selected workspaces is then texture 
mapped to a polygonal surface. Then the surfaces are 
displayed at orientations to form a polyhedron with a 
workspace on each face. Each face may be translucent so 
that workspaces otherwise hidden by that face are visible. 
The polyhedron rotates under the user's control so that each 
face is presented to the user, It is this combination of a 
three-dimensional figure with real-time rotation and texture 
mapping that gives this "Four-Dimensional Graphical User 
Interface" its name. 

18 Claims, 5 Drawing Sheets 
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FOUR-DIMENSIONAL GRAPHICAL USER left and right sections appear to extend away from theuscr 

INTERFACE at an angle. The user may * stretch the center section, 

resulting in a corresponding compression of the left and 
BACKGROUND OF THE INVENTION right sections, to view the central portion of the workspace 

5 in greater detail. 

1. Field of the Invention Returning to a typical GUI. when the user "opens" the 
The present invention relates generally to graphical user ^ g ^ m windows®, by "double-clicking" the mouse 

interfaces (GUI) for computer systems, and more partial- button while the cursor is positioned on the icon), the 
lariy to computer system GUIs that permit the user to utilize command represented by the icon is executed. Generally, an 
a workspace of greater effective area than that permitted by io lcon represents an application, which is launched when the 
the size of the display screen. command is executed. As a user adds more applications to 

2. Related Art the desktop more icons are required. At some point the 
In a typical computer system, the user interacts with the number of icons exceeds the available display space In 

system via various input devices, such as a keyboard and response, a number of strategies have been implemented, 
mouse, and various output devices, usually a video display 15 One such strategy is to provide "scrollable" windows. In 
terminal having a screen for displaying images and text to this scheme, the workspace is larger than its window, so only 
the user. In operation, the computer system executes a a portion of the workspace is visible at any given time, 
computer program called the "operating system," which Horizontal and/or vertical "scroll bars* are provided to 
allows other programs and the user to control the computer "scroll" the workspace past the window, thereby enabling 
system. The portion of the operating system that allows the 20 the user to look at different portions of the workspace, 
user to control the computer system is called the "user Another such strategy is to provide multiple windows, 
interface." The various schemes for implementing the inter- ^ con taimng a portion of the total set of icons. The user 
face are generally categorized by the manner in which the different icons by selecting different windows. But 

user interacts with the system. For example, in a typical because the windows must overlap, the user can see only a 
character user interface (ChUI) such as DOS®, the user 25 portion 0 f the total set of icons at any given time, 
inputs text from the keyboard, and the system returns text to ^ ^^^jack to aU of the prior schemes is that only a 
the screen. However, in a graphical user interface (GUI) ^THon of the total set of icons is visible at any given time, 
such as Windows®, the user can interact with the system by What is needed & a mc thod to permit the user to view a large 
manipulating graphical objects on the display screen. ^ Qumber of icons simultaneously. 

The display of a typical GUI comprises at least one 
■^window" (a framed user workspace which can be manipu- SUMMARY OF THE INVENTION 

lated independently of that portion of the display screen ^ ^ mvcDtioil ^ a system and method for dis- 
outside the frame) containing a number of objects viaymR a workspace of greater effective area than that of the 
(hereinafter called "icons") which represent various 33 jjJ * screen using a four-dimensional graphical user inter- 
commands, applications, and the like. While the typical GUI J Acc(XiiiRg t0 a preferred embodiment of the present 

display consists of two-dimensional objects such as the inventioiK up t0 six workspaces may be displayed 
above-described windows and icons, a number of user simultaneously< onc on each side of a rotating cube. The 
interfaces have been developed which employ three- workspaces are translucent so that all six workspaces are 
dimensional constructs. ^ to the user simultaneously. It is this combination of 

One such construct disclosed in U.S. Pat No. 5303388, a three-dimensional figure with real-time rotation that gives 
is a three-dimensional icon where the faces of the icon can ^ **pour-Dimensional Graphical User Interface" its name, 
display information regarding the properties of the object ^ ^ mvemion is a com puter system having a 
represented by the icon. The user can view hidden faces of ^ uscr interface (CUD system for simultaneously 

the icon by manipulating the icon using the mouse or 45 Jspiaying a plurality of windows. Th windows are first 
keyboard. In one enibcxliment the icon may represent a file mapped to a number of polygonal surfaces. Then the 

folder containing objects that may be displayed on a trans- polygonal surfaces are displayed at respec- 

lucent face of the icon. The user may select a particular ^ ^^Jg", to form a polyhedron. The polyhedron 
object open a document associated with an object or move ^ ^ of a num ber of faces, each 

an object in or out of the file folder. 50 of which is ^ of mc wm ^ 0WSt Thus, a user can simulta- 

Ad other such construct disclosed in U.S. Pat No, 5,148, neously view more than one of the windows. 
154, is a user interface for use in audio-visual production ^ a „ efejrcd embodiment, the workspaces are operating 
which permits multiple views of a conceptual three- windows containing icons which represent applica- 

dimensional object. The conceptual object is essentially a 

ttoee-Oimensional bar chart ^^^f^^ 55 In alternate embodiments, the workspaces are application 
three-dimensional boxes disposed in parallel upon a pUme. con taining text and/or graphics for user manipu- 

The user may select one of only six views of the object w "* w 6 
where one face of a box is orthogonal to the user's line of latton. 

STco^ei. the user can never view mare than one One advantage of the present Invention £<^ Upenn£ 
^ of i box ii one view. While the user can look at „ ^ telia ^rr^T^^"^f^^ 
multiple views simultaneously, he cannot view the concep- will be possible in a standard two^iimensional wwdow. 
tual object in perspective. Another advantage of the present invention is that it 

Another such construct, disclosed in U.S. Pat No. 5339, permits a user to view a larger effective workspace than 
39??a "sSS" woSpace that enables the user to view would be possible in . standard two-dimensional window, 
a portion of the workspace in greater detail. The workspace 63 Further features and advantages of the present invention 
is divided into a left right, and center section, where the as well as the structure and operation of various embodi- 
center section is orthogonal to the user's line of sight and the ments of the present invention are described in detail below 
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with reference to the accompanying drawings. In the buttons 210, 211. Workspace 202 is a display area containing 

drawings, like reference numbers indicate identical or func- graphical representations of the objects, such as icons, that 

tionally similar elements. Additionally, the left-most digit of the user is manip ulating Title bar 204 contains the title of 

a reference number identifies the drawing in which the the window, and is used for moving the window about the 

reference number first appears. 5 screen of the display. Re-size button 206 is used to change 

the size of window 104 to display more or less of workspace 

BRIEF DESCRIPTION OF THE FIGURES 202. Scroll bars 208, 209 are displayed whenever, because 

vrn 1 a~~:~ a a- -1 * . , the size of workspace 202 exceeds the size of window 104, 

RG. 1 depicts the display of a typical GUI portions of workspace 202 are hidden from view. By 
FIG. 2 depicts a typical window. 10 manipulating scroll buttons 210, 211, the user can view the 

FIG. 3 depicts an exemplary computer system operating hidden portions of workspace 202. 

according to the present invention. Referring again to FIG. 1. superimposed on desktop 102 

FIG. 4 depicts a display of a cube 400. are a number of windows 104, each containing a number of 

FIG. 5 depicts the display of the four-dimensional GUI of icons 106 - Topically, each icon 106 represents a command 

the present invention according to a preferred embodiment 13 ^ user execute by "double-clicking" on icon 106 

vtn * A«~i~** «,k» caa . ^ ... usm 8 a moose button. In the preferred embodiment, each 

FIG. 6 depicts cube 500 after rotation to a new position. V ,. *. . rv^" ~" 

*^ icon 106 represents an application, which is launched by 

DETAILED DESCRIPTION OF THE I*™*?* * e coianmad represented by the icon 106. A 

PREFERRED EMBODIMENTS dtfBculty that the user experiences with the GUI of FIG. 1 is 

20 that not all of the icons 106 are visible simultaneously 

The preferred embodiment of the invention is discussed in because the windows 104 overlap. Even if all of the icons 

detail below. While specific steps, configurations and were transferred to a single window 104. there are 

arrangements are discussed, it should be understood that this simply more icons 106 than can be displayed simultaneously 

is done for illustrative purposes only. A person skilled in the in the available space on the display. What is needed is a 

relevant art will recognize that other steps, configurations 23 method for viewing all icons 106 simultaneously, 

and arrangements can be used without departing from the HA Four-Dimensional GUI 
spirit and scope of the invention. 

The present invention is a system and method for dis- 

1 A Typical GUI playing a workspace of greater effective area than that of the 



display screen using a four-dimensional graphical user inter- 



A typical configuration for a personal computer system 30 face. According to a preferred embodiment of the present 

includes a processing unit, a display, a keyboard, and a invention, up to six workspaces may be displayed 

mouse. The processing unit executes a computer program simultaneously, one on each side of a rotating cube. The 

called the "operating system," which allows the operation of workspaces are translucent so that all six workspaces are 

the computer system to be controUed either directly by the visible to the user simultaneously 

user or by othercomputer programs called "applications - A After reading the following discussion, it will be apparent 

user operates th c computer system by entering commands to a person skilled in the relevant art how other workspaces 

using the keyboard and mouse; in response, the processing can be displayed according to the present invention. 

u^r v^l^v^^ ^JSF"" """f to ** " one embodiment, the present invention is directed to a 
user via the display. The portion of the operating system that ^ ^ herein ^ cxem . 

S the "C^t^ fCCdbaCk * ™* * Pi*? compter sys£m M is shownt HG 3 . Kc Z- 
uxa: uiicnaec. putcr system 300 includes one or more processors, such as 
The various schemes for implementing the user interface processor 304. The processor 304 is connected to a corn- 
are generally categorized by the manner in which the user munication bus 306. 

interacts with tte system. For example, in a typical character 45 The computer system 300 also includes a main memory 

^T^t^ SUCh " ^ * C USCr 308, prefeAbly random access memory (RAM), and^ 

from the keybc^; in response the computer system returns secondary memory 310. The secondary memory 310 can 

£^!Tim° * h ^ H0 T C ^ 1D " " Ser ****** example, a hard disk drive 312 and/or a remov- 

mterface (GUI) such as Windows®, the usei : can interact able storage drive 314. representing a floppy disk drive; a 

with me center system by mampulaung graphical objects „ magnetic tape drive; a compact disk drive^r the like, lie 

on the display screen using the keyboard and/or the mouse. removable storage drive 314reads from and/or writes to a 

FIG. 1 depicts the display of a typical GUI The display removable storage unit 318 in a well known manner, 

screen is filled with a background 102 called the "desktop". Removable storage unit 318, also called a program stor- 

Superimposed on desktop 102 are a number of rectangular age device or a computer program product, represents a 

graphical objects 104 called "windows'*. A window 104 is a 55 floppy disk, magnetic tape, compact disk, or the like. As will 

framed user workspace which can be manipulated indepen- be appreciated, the removable storage unit 318 includes a 

denuy of that portion of the display screen outside theframe. computer usable storage medium having stored therein 

For example, a window in a word processing application can computer software and/or data. 

ZSSSL fn T ° f a d °f. Un !f nt uscr f» V Computer programs (also called computer control logic) 

window £ a drawing WUcaUoo can contain the figure the « are stored in'main memory and/or theVecondary memory 

user is drawing. A window belonging to a computer oper- 310. Such computer programs, when executed, enabled 

X^ZT nt T " iCOnS ' H Whi< * r P^** computer system 3(N>V^ the featured S«e2 

gay objects representing commands, applications, and the invention as discussed herein. In particular, the computer 

* ^ programs, when executed, enable the processor 304 to 

FIG. 2 depicts a typical window 104. Window 104 65 perform the features of the present invention. Accordingly 

comprises a workspace 202, a title bar 204, a resize button such computer programs represent controllers of the com- 

206. horizontal and vertical scroll bars 208, 209 and scroll putcr system 300. 
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In another embodiment, the invention is directed to a windows on the far side of the cube are visible to the user, 

computer program product comprising a computer readable One window has been selected by the user, it is therefore 

medium having control logic (computer software) stored opaque. FIG. 6 depicts cube 500 after rotation to a new 

therein. The control logic, when executed by the processor position. The user may select icons 106. add or delete icons 

304. causes the processor 304 to perform the functions of the 5 106. or launch the applications represented by icons 106. 

invention as described herein. In an alternate embodiment of the present invention, the 

In another embodiment, the invention is implemented windows which are texture-mapped to the faces of the cube 
primarily in hardware using, for example, a hardware state are application workspaces. As described above, the work- 
machine. Implementation of the hardware state machine so spaces may be translucent, and the cube may rotate 
as to perform the functions described herein would be »o automatically, under user control, or both. After reading the 
apparent to persons skilled in the relevant art above description, it will become apparent to a person 

The present invention is a fourniimensional GUI for skilled in the relevant art how to implement the invention 

displaying a plurality of windows 104 simultaneously. using other alternative einbodiments. 

According to the present invention, a polyhedron is fast A number of further features of the present invention are 

generated and displayed. Then, the user selects one or more ,s discussed below. Drop-down menus are provided for the 

windows to be displayed on the faces of the polyhedron. The user to access these features. First, when the user decides to 

user may select as many windows as the polyhedron has view the cube, the user selects the "cubeffonnation" item 

faces In the preferred embodiment, the polyhedron is a from the drop-down menu. In response, the GUI causes the 

cube- thus up to six windows 104 may be displayed simul- desktop to 'Tall" away from the user, revealing the cube. The 

taneousiy 20 user can select default images so that these images are 

One advantage of the present invention is that it permits displayed on the faces of the cube when it is first Jfcnned. 

a user to view a larger effective workspace than would be The user can then select windows to be applied to the faces 

possible in a standard two-dimensional window. Now, this is of the cube. Once one or more wmdows is mapped onto .the 

dtn^nstrated by example with reference to FIG. 4. FIG. 4 cube.theuser canselect a wmdow. to response ■^ex* 

depicts a display ofacSbe-type polyhedron 400 on a screen 25 window *en becomes opaque. If the user wishes toedi ^a 

wim a total surface area of 48 inches. When orthogonal to window, the user can remove a window from fte cube and 

mTvfew ™ , line of sight each edge of cube 400 measures edit it as a standard, two^limens.onal window. Once edited. 

4 inches so that each face of cube 400 has an area of 16 me window can be reapplied to the cube. 

inches. Thus cube 400 has a total usable workspace area of The user can select any viewpoint from which to view the 

96 inches. Thus, in this example, the total display area of the cube, even a viewpoint inside the cube. As a result the cube 

cube is twice mat of the screen. is scalable. The user can also control the rotation and 

In a preferred embodiment of the present invention, at orientation of the cube. To facilitate orientation, the user 

least one face of the cube is translucent This arrangement may select "axis Ulumiaation. In response, illuminated 

permits the user to view a greater number of cube faces (Le.. „ ««-« ne ^ ondto ^ f ^ of ^^^^ y ^ 

windows) simultaneously. When all six windows are Control points arc provided at regular intervals along the 

translucent, the user can sec all of the icons at once. Icons axes for the user to "grab" using the mouse and drag to 

on faces of the cube which are seen through other faces will orient the cube. When the u« «*» ^ ««™ ^ d« 

appear laterally inverted, i.e. mirrored; this property allows desktop, the user selects "cube^sband from me drop- 

meuTer to perceive the orientation of the cube. When a user down menu. In response the cube disappears, the desktop 

selects a window, it becomes opaque for ease of viewing. "° rises to fill the screen, and any wmdows that were mapped 

to a preferred embodiment of me present invention, the to the cube reappear on the desktop, 

cube can rotate in any one of at least three modes: (1) the As a further feature of the present mventaon, the user may 

c„be may rotate constantly. (2) the cube may rotate under the elect to have more than one cube > disptay ed siinuftaneously, 

user's control, or (3) both. The cube has a default rotation 45 permitting an even greater number of windows to be dis- 

Su^suchAateacnfaceofmecubeismsptoyedasnormal played. Each cube may be minimized so that it is represented 

to the user's line of sight once during each rotation cycle. by a small, spinning-cube icon. 

However, the rotation speed and pattern may be controlled m ConclusJon 

by the user via the keyboard and the mouse. _ . 

to a preferred embodiment of the present invention, the so . While various embodiments iofj Die P^"™"™^ 

windows are applied to the faces of the cube by a process been described above, it should be understood thai they have 

known as "texture mapping." which is the application of an been presented by way of example, and not lumtatton. It will 

5 to the surfaceofa displayed object When the cube is be apparent to persons skilled in *e relevant art that various 
routing, the texture mapping must be executed in real time. changes in form and detail can be made therein without 
Such real-time texturemapping is possible using a work- 55 departing from the spirit and scope of the .invention Thus toe 
nation computer system Tuch as ti.e Silicon Graphics present invention should not be ltanted by any of the 
Onyx® « wring a personal computer system such as the above^escribed exemplary embodiments, but should be 
Smcon Graphics IndiwH Impact®. Itis this combination of defined only in accordance with the following claims and 
a threeSnsionalfigure with real-time rotation and tex- their equivalents. All cited patent documents and I publica- 
ture mapping that gives this "Four-Dimensional Graphical so lions in the above description are incorporated heron by 
User Interface" its name. reference. 

FIG. 5 depicts the display of the four-dimensional GUI of What is claimed is: 
the presenXentioaTccording to a preferred embodiment 1. A computer system having a graphical user interface 
A citeSM is displayed. Six different windows 104 have (GUI) system for simultaneously displaying a plurality of 
been texture mapped onto cube 500, one window 104 per 65 windows, comprising: 

face. Each window 104 contains a plurality of icons 106. means for texture mapping the windows to a number of 
The windows 104 are translucent so that icons 106 in polygonal surfaces; and 
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means for displaying said texture mapped polygonal 
surfaces at respective orientations to form a 
polyhedron, said polyhedron thereby appearing to be 
comprised of a number of faces, each of said faces 
comprising one of the windows, and thereby permitting 
a user to simultaneously view more than one of the 
windows. 

2. The system of claim 1. where said polyhedron is a cube. 

3. The system of claim 1* further comprising means for 
rotating said polyhedron so that each face is visible to the 
user. 

4. The system of claim 1. further comprising means for 
rotating said polyhedron in response to user input via said 
control means. 

5. The system of claim 1. wherein at least one of the 
windows is translucent. 

6. The system of claim 1. wherein at least one of the 
windows is scrollable. 

7. A system for displaying a plurality of graphical user 
interface (GUI) windows simultaneously, comprising: 

a processor, and 

a controller to control said processor, comprising: 
means for texture mapping the windows to a number of 

polygonal surfaces; and 
means for displaying said texture mapped polygonal 
surfaces at respective orientations to form a 
polyhedron, said polyhedron thereby appearing to be 
comprised of a number of faces, each of said faces 
comprising one of the windows, and thereby permit- 
ting a user to simultaneously view more than one of 
the windows. 

8. A controller for displaying a plurality of graphical user 
interface (GUI) windows simultaneously, comprising: 

means for texture mapping the windows to a number of 
polygonal surfaces; and 

means for displaying said texture mapped polygonal 
surfaces at respective orientations to form a 
polyhedron, said polyhedron thereby appearing to be 
comprised of a number of faces, each of said faces 
comprising one of the windows, and thereby permitting 
a user to simultaneously view more than one of the 
windows. 

9. A computer program product for use with a database 
and data processing system memory, said computer program 
product comprising: 

a computer usable medium having computer readable 
program code means embodied in said medium for 
displaying a plurality of graphical user interface (GUI) 



windows simultaneously, said computer readable pro- 
gram code means comprising: 
a computer readable first program code means for 
causing a computer to texture map the windows to a 
number of polygonal surfaces; and 
a computer readable second program code means for 
causing the computer to display said texture mapped 
polygonal surfaces at respective orientations to form 
a polyhedron, said polyhedron thereby appearing to 
be comprised of a number of faces, each of said faces 
comprising one of the windows, and thereby permit- 
ting a user to simultaneously view more man one of 
the windows. 

10. The computer program product of claim 9. comprising 
a further computer readable program code means for causing 
the computer to rotate said polyhedron so that each face is 
visible to the user. 

11. The computer program product of claim 9, comprising 
a further computer readable program code means for causing 
the computer to rotate said polyhedron under user control. 

12. The computer program product of claim 9. comprising 
a further computer readable program code means for causing 
the computer to cause at least one of the windows to be 
translucent. 

13. The computer program product of claim 9. comprising 
a further computer readable program code means for causing 
the computer to cause at least one of the windows to be 
scrollable. 

14. A method for displaying a plurality of graphical user 
interface (GUI) windows simultaneously, comprising the 

30 steps of: 

(a) texture mapping the windows to a number of polygo- 
nal surfaces; and 

(b) displaying said texture mapped polygonal surfaces at 
respective orientations to form a polyhedron, said poly- 
hedron thereby appearing to be comprised of a number 
of faces, each of said faces comprising one of the 
windows, and thereby permitting a user to simulta- 
neously view more than one of the windows. 

15. The method of claim 14, further comprising the step 
of rotating said polyhedron so that each face is visible to the 
user. 

16. The method of claim 14. further comprising the step 
of rotating said polyhedron under user control. 

17. The method of claim 14, wherein at least one of the 
windows is translucent 

18. The method of claim 14, wherein at least one of the 
windows is scrollable. 
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